As you are trying to enter the High Tower unannounced, the guards run towards you and block your way.